Design and Implementation of a Multi-Modal Wireless Robotic System for Smart Vehicle Navigation

Abstract

This paper describes the design and development of a multi-modal wireless robotic system for the robotic vehicle that can be controlled manually by Bluetooth, voice, and navigation by gestures. In this, the Arduino is the center of the controlling unit that combines the communication and sensing modules. There is an HC-05 Bluetooth module that allows manual and voice commands by the smartphone app. In controllinggestures,itusesanaccelerometer-gyroscopesensor, an MPU-6050 module, where a reliable means of wireless data transfer is done using RF transceivers, nRF24L01. In motor control, it uses an L298N motor driver and DC motors. For safety reasons, an ultrasonic sensor is employed for real-time obstacle detection. On detection of an obstacle within a fixed distance,thevehicleautomaticallystopstoavoidcollisions.The results demonstrate that there is stable communication, good controlresponse,efficientobstacleavoidance,andsmoothmode switching. The new system provides enhanced flexibility and convenience and can be applied to educational robots, mobility aids, and surveillance systems.

Introduction

This paper presents the design and implementation of a multi-modal robotic vehicle control system that combines Bluetooth-based manual control, voice-command control, and gesture-based control within a single platform. Traditional robotic vehicles typically rely on a single control method, limiting flexibility and user interaction. To overcome these limitations, the proposed system integrates multiple control modes with automatic mode switching and a unified safety mechanism.

The system is built around an Arduino Uno microcontroller and uses an HC-05 Bluetooth module for smartphone-based manual and voice control, an MPU6050 accelerometer/gyroscope with nRF24L01 RF transceivers for gesture recognition and wireless communication, and an L298N motor driver for vehicle movement. An ultrasonic sensor continuously monitors the environment and automatically stops the vehicle when obstacles are detected within a predefined distance, ensuring collision avoidance across all operating modes.

The methodology includes Bluetooth communication setup, voice-command processing through a smartphone, gesture detection using tilt-angle calculations from MPU6050 sensor data, wireless RF transmission of gesture commands, and real-time command interpretation by the Arduino. The system prioritizes the latest valid input and supports seamless switching between control modes without user intervention. Mathematical models describing differential-drive motion, ultrasonic distance measurement, and gesture-angle computation are also developed to analyze system behavior.

Experimental testing demonstrated successful operation in all three control modes. Bluetooth control achieved 98% accuracy with a range of approximately 10 m, voice control achieved 92% accuracy in low-noise environments, and gesture control achieved 90% accuracy with an extended communication range of approximately 25 m. Response delays ranged from 80–200 ms depending on the control mode. The ultrasonic safety system reliably detected obstacles and halted the robot in all cases.

Conclusion

Inthissection,experimentalanalysisandresultsofintegrating the multi-modal robotic controlling system by using Bluetooth, Voice, and Gesture modes will be described. Figure4showsapracticalprototypedevelopedinthisstudy. Therobotsweretestedbymeansofar oboticcarcontrolledby threedifferentcontrolmethods. Inthecontrolmodebasedon Bluetooth,thecommunicationofthesystemisstablewithina rangeofabout10m,withsmoothand accurate controlthrough a smartphone. Voice controlhadanaverage voicecommand recognitionaccuracyofaround92%inlow-noiseconditions, andtheperformancewasslightlyimpactedbythepresenceof background noise. The system of control by gestures, developedusing theMPU6050 sensorandannRF24L01 RF module, facilitated intuitive controlby tiltmotionsof hands, thoughsomein accuraciesoccurredduringfastmotionofthe

References

[1] S. Sharma and M. Iqbal, “Bluetooth-Based Wireless Control of MobileRobots,” IEEE International Conference on Robotics and CommunicationSystems (ICRCS), pp. 45–50, 2019. [2] R.PatelandA.Kumar,“ChallengesinHuman–RobotInteraction:AReview,”IEEEAccess,vol.8,pp.12436–12449,2020. [3] A.Singh,P.Mehta,andR.Jain,“HandGestureControlledRobotUsingMPU6050 Sensor,” International Journal of Engineering Research, vol. 9,no. 4, pp. 233–238, 2020. [4] S. Kumar and R. Verma, “Voice Operated Robotic Vehicle UsingAndroid,” International Conference on Communication andSignalProcessing, pp. 112–117, 2018. [5] Y.Li,H.Wang,andX.Chen,“WirelessCommunicationUsing nRF24L01forRoboticApplications,”IEEESensorsJournal,vol.19,no.5, pp.1984–1991,2019. [6] J.Zhao,L.Sun,andK.Liu,“UltrasonicBasedObstacleDetectionforMobileRobots,”InternationalJournalofRoboticsResearch,vol.37,no.8, pp.987–995,2018. [7] M. Brown and T. Wilson, “Arduino-Based Robotic Systems,” IEEEEmbedded Systems Letters, vol. 11, no. 2, pp. 45–49, 2019. [8] D.GuptaandN.Sharma,“GestureRecognitionTechniquesforHuman–MachineInteraction,”InternationalJournalofComputerApplications,vol.182, no. 3, pp. 12–18, 2018. [9] P. Reddy and K. Rao, “Design of Obstacle Avoidance Robot UsingUltrasonic Sensors,” International Journal of Advanced Research inElectrical Engineering, vol. 7, no. 1, pp. 21–26, 2019. [10] A. Malhotra and S. Kaur, “Bluetooth Communication in EmbeddedSystems,”InternationalJournalofElectronicsandCommunication,vol.10,no. 2, pp. 89–94, 2017. [11] R.MehtaandV.Shah,“RFCommunicationforRoboticControl,”IEEEInternational Conference on Industrial Technology, pp. 341–346, 2018. [12] L.ZhangandY.Liu,“Multi-ModalControlSystemsinRobotics,”IEEETransactionsonRobotics,vol.34,no.6,pp.1567–1575,2018. [13] S. Patel and J. Desai, “Assistive Robotics for Disabled Users,”InternationalJournalofHealthcareEngineering,vol.6,no.4,pp.201–207,2019. [14] A. Verma and P. Singh, “Human Gesture-Based Interfaces,” IEEEConsumer Electronics Magazine, vol. 8, no. 3, pp. 44–50, 2019. [15] K.LeeandM.Park,“WirelessSensorNetworksinMobileRobotics,”Sensors,vol.18,no.12,pp.4021–4030,2018. [16] N.JoshiandR.Kulkarni,“Real-TimeRoboticNavigationSystems,”InternationalJournalofAutomation,vol.9,no.1,pp.55–61,2017. [17] S.AhmadandT.Khan,“VoiceRecognitionSystemsforRobotics,”IEEEInternationalConferenceonAIandRobotics,pp.210–215,2020. [18] H. Kim and J. Lee, “Sensor Fusion Using Accelerometer and Gyro-scope,” IEEE Sensors Conference, pp. 1023–1028, 2019. [19] M. Sharma and P. Gupta, “Collision Avoidance Techniques in MobileRobots,”InternationalJournalofIntelligentSystems,vol.14,no.2,pp.133–139,2018. [20] R.ThomasandS.Roy,“EmbeddedMotorControlUsingL298N,”InternationalJournalofEmbeddedSystems,vol.5,no.3,pp.77–83,2019. [21] A.ChoudharyandN.Jain,“DesignofLow-CostRoboticVehicles,”IEEEStudentConferenceonEngineering,pp.56–60,2018. [22] P.SinghandA.Nair,“Android-BasedControlApplications,”InternationalJournalofMobileComputing,vol.7,no.2,pp.98–104,2017. [23] T.NguyenandD.Tran,“SPICommunicationinEmbeddedSystems,”IEEEEmbeddedSystemsConference,pp.144–149,2019. [24] K. Wilson and J. Martin, “IoT Integration in Robotics,” IEEE Internetof Things Journal, vol. 6, no. 3, pp. 4892–4899, 2019.

Copyright

Copyright © 2026 Chaitanya Pilane, Dhanashri Pawar, Mansi Patekari, Lakshaya Pillai, Milind Patil. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.